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WO 01/15132 PCT/NZOO/00160 
CONTROL OF DEPTH MOVEMENT FOR VISUAL DISPLAY WITH LAYERED SCREENS 



Technical Field 

This invention relates to a visual display system. 
BACKGROUND ART 

5 Particularly, the present invention relates to a visual display system including multi- 
level screens which are placed physically apart. 

Such screens are described in PCX Application Nos. PCT/NZ98/00098 and 
PCT/NZ99/0002L 

These devices are created by combining multiple layers of selectively transparent 
h 10 screens. Each screen is capable of showing an image. In preferred embodiments the 



m 

screen layers are liquid crystal display. Preferably the screens are aligned parallel to 



each other with a pre-set distance between them. 

With this device images displayed on the screen furthest from view (background 
screen) will appear at some distance behind the images displayed on the screen closer 
15 to the viewer (foreground screen). The transparent portions in the foreground screen 
will allow viewers to see images displayed on the background screen. 

This arrangement allowing multiple screens allows images to be presented at multiple 
levels giving the viewer true depth without use of glass or lens. 

Up until now, software has been written to create visual sequences on the multi-level 
20 screens. These sequences have been mainly passive, mainly for viewing rather than 
for interaction. 

While the visual effect of these sequences is spectacular, it will be desirable if 
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potential uses of a multi-level screen display could be explored further. 

It is an object of the present invention to address this problem, or at least to provide 
the public with a useful choice. 

Aspects of the present invention will now be described by way of example only with 
5 reference to the following description. 

Disclosure of Invention 

According to one aspect of the present invention there is provided a visual display 
system including 

multi-level screens spaced physically apart, 
10 wherein each screen has a two-dimensional plane, 
a visual indicator, 
an input device, 
a user selectable input, 

the visual display system being characterised in that 

15 the user can use the user selectable input to move the visual indicator via the input 
device out of the two-dimensional plane of a particular screen. 

According to another aspect of the present invention there is provided a method of 
using a visual display system which has multi-level screens spaced physically apart, 

wherein each screen has a two-dimensional plane, 

20 the visual display system also including 
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a visual indicator. 



PCT/NZ00/00i60 



an input device, 

a user selectable input, 

the method characterised by the step of 

5 the user using the selectable input to move the visual indicator out of the two- 
dimensional plane of a particular screen and on to another screen and on to another 
screen. 

One aspect of the present invention there is provided media containing instructions 
for the operation of visual display system as described. 

10 In preferred embodiments of the present invention the multi-level screens are similar 
to that described in PCX Application Nos. PCT/NZ98/00098 and PCT/NZ99/0002 1 , 
although this should not be seen as limiting. 

The term two-dimensional plane refers to the effective viev^ing plane on a particular 
screen, similar to that seen on a normal display screen. 

15 The visual indicator may be any type of indicator, for example a cursor, image, icon 
or screen image. It is envisaged that the visual indicator is something which can 
move in response to the user of the system via some input mechanism. 

The input device may be any suitable input device, for example a mouse, tablet data 
glove, keyboard, touch screen, joystick, trackball, pen, stylus, touch pad, voice and so 
20 forth. 

The user selectable input is preferably an input the user can make to effect the 
operation of software running the display device via the input device. 
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For example, if the input device is a mouse, then the user selectable input may be a 
mouse button, tf the input device is a joystick, then the user selectable input may be 
the trigger. If the user input is a keyboard, then the user selectable input may be 
arrow keys. And so forth. 

5 We envisage that the present invention could be used extensively by those in the 
graphics industry. Therefore one embodiment in the present invention is envisaged 
that by having the input device as a pen or stylus, the present invention could be 
utilised in theses industries to its fullest. 

In some embodiments, the user selectable input may actually be a software button on 
10 a touch screen that may be independent of the input device. This allows standard 
input devices and drivers to be used without modification. 

In further embodiments of the present invention, the input device shall be referred to 
as a mouse and the user selectable input shall be referred to as a mouse button. The 
mouse button may be an existing button on the mouse, or in some embodiments may 
15 be a dedicated button for use with the present invention. 

This should not be seen as limiting. 

The visual indicator shall now be referred to as a cursor, although this should not be 
seen as limiting. 

The user can use a mouse to move a cursor around a display screen as can be 
20 achieved with usual software. However, with one embodiment of the present 
invention, the user can then click a particular mouse button to cause the visual 
indicator to move from one screen to another screen. In one embodiment the 
applicant uses the centre button or a configurable button on a three button mouse, but 
this should not be seen as limiting 
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Ati preferred embodiments the software controlling the cursor position is 
supplemental to usual mouse drives. 

Therefore a program can run as usual with standard mouse drive commands but the 
cursor position between screens can change as a consequence of the interaction of the 
5 supplemental program responding to the additional input from the mouse. 

This ability enables the user to actually interact with different screens and work on 
separate screens in terms of having an input device which can interact with whichever 
screen has been selected. The advantages of this feature are self apparent. 

In some embodiments, the movement from the two-dimensional plane of one sct^een 
10 to another screen may discrete and it may appear that the visual ittdicdtor merely 
jumps from one screen to the other and be at the same x-y coordinate with the only 
change being in the z axis. 

In other embodiments^ there m^y be more of a Utiear movement perceived as a 
consequence of the nldvement from dne screen to the other. 

15 For example, the present invention may be used in conjunction with a drawing 
package. The person drawing may start drawing on the front screen of the visual 
device using the mouse and cursor. 

The person then may wish to take advantage of the three dimensional quality allowed 
by the present invention and effectively draw in the z axis (the x and y axis having 
20 already been drawn in on the two-dimensional screen). This may be achieved by the 
user clicking the mouse button and dragging the cursor effectively so it appears to 
pass from one screen to the other screen with an image (say a line) appearing to 
provide a visual bridge between the front screen and another screen or screens in the 
background. 
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In other embodimetits of the present invention this ability may be used with particular 
total screen images. Fw example, the present invetitidn may be used with an 
interactive game which gives the impression that the user is moving deep within a 
scene. For example, the user may be flying a craft in the game and as the user moves 
5 forwdrd in the game, the images may pass from the background screen or screens to 
the fbi-egrohnd screen giving the illusion of full movement. In this embodiment the 
visual indicator may be the images and the iiiput device a joy-stick. 

Aspects of the present ihvetltion will now be described with retei^hce tb the 
following drawings which are given by way of example only. 

10 BRIEF DESCRIPTION OF DRAWINGS 

Further aspects of the present invention will become apparent from the following 
descriptioh which is given by way of example only atid with reference to the 
tecompiUiyitlg drawings in whichi 

Plpx^e 1 illustrates one embodimeht of the preseht invehtldti, nhd 
15 Figure 2 illustrates a second embodiment of the present invention, and 
Figure 3 illustrates a third embodiment of the present invention. 
Best Modes for Carrying out the Invention 

Figures la and lb illustrate a stylised version of one embodiment of the present 
invention at work. These figures have foreground screens 1 and background screens 
20 2. 

It should be appreciated that the reference to just two screens is by way of example 
only and the present invention may work in relation to multiple numbers of screens. 

Figure la shows the positioning of the visual indicator 3 in the form of a cursor arrow 
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on the front foreground screen 1. 

In this embodiment of the present invention a simple click of a mouse button causes 
the cursor 3 to appear in exactly the same x y coordinates as on the foreground screen 
one, but, positioned on the background screen 2. 

5 Thus in this embodiment, the user selectable input merely does a direct transpose in 
the z axis between screens. 

Figure 2 likewise has a foreground screen 1 and a background screen 2. In Figure 2a. 
a triangle 4 has been drawn on the x y two-dimensional plane of the foreground 
screen 1. 

10 In Figure 2b, to give the triangle 4 depth, the user has selected and dragged the image 
in the x y direction to give not only the image of a triangle 5 on the background 
screen 2, but also a plane in the z axis 6 for finding a solid-looking representation. 
As the screens are physically quite separate, the illusion of the solid wall 6 is 
accomplished by sophisticated software shading techniques. 

15 Figure 3 again has a foreground screen 1 and background screen 2. 

This embodiment of the present invention can be used for moving through three- 
dimensional landscapes. For example, in Figure 3a, there is pictured a flower 7 on 
the foreground screen, tree 8 along with a cloud 9 are positioned on the background 
screen 2. 

20 The user may then use the input device to effectively move through the scene 
visually. This causes the flower depicted in Figure 3a to disappear from the 
foreground screen as shown in Figure 3b. This also causes the tree 8 to move from 
the background screen 2 to the foreground screen L The cloud 9 being in the far 
background stays on the background screen 2. 
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Thus it can be seen that the present invention allows considerable amount of 
interaction between the user and the screens. 

Aspects of the present invention have been described by way of example only and it 
should be appreciated that modifications and additions may be made thereto without 
5 departing from the scope of the appended claims. 
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5, 



A visual display system including 

multL-level sprsen spaced physically apait, 

wherein each screen has a 2 dimensional plane, 

a visual indicator, 

a input device, 

a user sdecLable ijq>ut:, 

the visual display systeoi being charactorised in that 

the user can use the selectable input to move the visual indicator via the input device 
out of the 2-dimensional plane, and onto another screen where both screens display 
images simultaneously. 

A visual display syst™ as claimed in claim I wherein the visual indicator is a cursor. 

A vijsual display Systran as claimed in dllier claim 1 or claim 2 wherein the input 
device is a mouse. 

A visual display system as claimed in any ono of claims 1 to 3 wherein the user 
selectable input Is a mouse button. 

A visual display system as claimed in any one of claims I to 4 which includes 
software supplemental to the software drivers for the input device to cause the visual 
indicator to move from one screen to anotlicr screen. 

A visual display system as claimed in any one of claims 1 to 5 wheitin tlic visual 
indicator moves to a different z axis coordinate, but the same x - y coordinate. 
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7. A visual display system as claimed in any one of claims 1 lo 6 wherein the movomeni 
of the visual indicator from one screen to another screen gives the appearance of 
providing ^ visual bridge between the soccns. 
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8, A visual display syi^eno as clainficd in any one of daims 1 to 7 wherein the visual 
indicator is a scat^sn imog^. 

9. A method of using a visual display system which has multi-Ievd screOT.s spaced 
physically apart, 

wherein each screen has a 2 dimensional plane 

the ^suat display system also including 

a visual indicator, 

a input device, 

a iiser selectable input, 

a method of charactedsed by the step of the user using the selectable input to move 
the visual indicator out of the 2-dimensional plane and onto another screen, where 
both screens display images simultaneously. 



jiy 10. A method as claimed in claim 9 wherein a visual indicator is a cursof. 

|[3 1 K A m^od as claimed in d&er claim 9 or claim 10 whcrdn the input device is a 



S mouse. 



12. A method as claimed in any one of claims 9 to 11 wherein the user selectable input is 
a mouse button. 

13. A method as claimed in any one of claitns 9 to 12 which includes software 
supplemental to the software drivers for the input device to cause the visual indicator 
to move from one screen to another screen. 
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^14 A m^hod as claimed in any one of claims 9 to 13 wherrin ihe visual indicator moves 
- ; to a different t; axis coordinate, but the same x - y coordinate. 



15. A method as claimed in any one of claims 9 to 14 wherein the movement of the 
visual indicator from one screen to another screen gives the appearance of providing 
a visual bridge between the screens. 

16. A method as claimed in any one of claims 9 to 15 wherein the visual Indicator is a 
screen image. 

17. A visual display system as claimed in any one of claims 1 to 8 whi^^in the input 
device is a pen. 

18. A method as claimed in any one of claims 9 to 16 wh^ein the input device is a pen. 

19. A method subsiantially as herein described with reference to and as illustrated by the 
company drawings* 



^ 20. A method of using a visual display ayst«n substantially as herein described with 

^ reference to and as illustrated by the accompanying drawings, 

P4 

f3 21. Media containing instructions for the operation of a visual display system as 

^ claimed/or described herein. 

1 
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State 



I T elephone 



23P 



I hereby declare that all statements made herein of my own knowledge are true and that a« statem|j)ts made on Infonnattoji and belief 
are believed to be taje; and further that these statements were made with the knowledge that willful false statements ^ *^"ke so 
macteae punls^^ by fine or imprisonment, or both, under 18 U.S.C. 1001 and that such willful false statements may jeopar<fize the 
validtty of fee appiteatfon or any patent issued thereon. 



NAME OF SOLS OR;BmST INVENTOR ; 



□ A petition has been filed for tills unsigned inventor 



Family Name 
or Surname 



inventor's 
Signature 




Mailing Address 



Counjay^ 



Citizenship 



Mailing Address 



City 



ZIP 



Country 



NAME OF SECOND INVENTOR: 



□ A petition has been filed for this unsigned inventor 



Given Name, 
(first at6^ddle 



FamliyName 
or Surname 



Inventor's 
Signature 





^3/0i/200Z 



Residence; City 



Mailing Address 



Country^ 



Citizenship 



Mailing Address 



ZIP 



Country^ 



□ AddWonai inventors are being n amed on the supplemental Addittonal lnventor(s) sheet(s) PTQ/SB/02A attached hereto, 
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nFTO/SB/OZA (3-87) 
PMMit and TradeiMHlC Oefk»: U.S. DEPARTMeNT OF (XM^xencE 
Under the Papefworic Roducdc« Act<rf t995,noperson«ai« iequirKlt&««po«floa«l^^ 

valid OMB controi nunnber, • 



DECLARATION 



/U^OrnONAL INVEmX)R(S) 
Supplemental Sheet 



Name of Additional Joint Inventor, H any: 



□ A peftten has been ©ed for Ihls unsigned tov^^ 



Given Name (first and middte anyB 



FartBy Name or Surname 



lriv«ntor*s 
SIgntuie 



Recldencc; City 



State 



CoMHtry 



Cttteenahip 



Post Office Address 



Post Office Address 



City 



Country 



Name of Additionai Joint Inventor, If any: 



Q A petition has been filed forHiis unsigned inventor 



Given Name (first and irtddie pf an^ 



FamBy Nan» of Surname 



Inventor's 
Signature 



Date 



Residence; City 



Country 



Cttfaeanahrp 



Post Office Address 



Pod Office Addrece 



City 



Name of Additional Joint Inventor, if any: 



Cotmlnf 



[[] A petition has been fSed for tiis unsigned inventor 



Given Name (first and iriddle pt any]) 



l=amfly Name or Surname 



tnventor's 
Signature 



Residence; Ctty 



State 



Country 



CItlzenahip 



Post Office Addiesa 



Post Office Address 



Ctty 



Country 



+ 



Biiiden Hour Statement: This fbitn is estknated to take 0.4 houia to complex. Time vary depondkw upon the nee^ of me IfwSvlduaJ caso. Any 
comments on the amount of time whi am iw»*sd to i»mpl»te this form 

Oflice. Washhgton. tx: 20231. DO NOT SEND FEES OR COMPI.ETED POfll^S TO THIS ADDRESS. SB© TO: Asairtai* Corwirisrioner for 
Paiams* Washington. OC 20231. 
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UrKier the Paperwofk RoduGlfon M of 1995, no 
vaBdCH^cocttroI number. 



PT<ySBA)2B (3-07) I 
Appravttdfor use through «3(m. 0^0651-0032 



DECLARATION — Supplemental Priority Data Sheet 



Additional foreign applications: 


Prior Foreign Application 
Numbei(s) 


Country 


Foreign Filing Date 
(MM/DO/YYYY) 


Priority 
Notaabned 


Cettffied Copy Attached? 
YES NO 








□□□□□□□□□□□□□□□ 


□□□□□□□□□□□□□□□ 
□□□□□□□□□□□□□□□ 


Additional Ofovislonai < 


itTDlications: 


Applieaiion Number 


Filing Date(IIIMA}D/YYYY) 






Additional U.S. applications: 


UJS. Parent Application 
Number 


PCT Parent 
NlfldHfiC 


Parent Fllbig Date 
(miuoDirrm 


Parent Patent Number 











BuitSen Hour Statement: INs loim i* osttmaM to like 0^ houro to oomptote. Tine wil vary depending upon the needs of the indhridual case. Any 
oomments on the amount of tirne you am leoAad ^ 

Washington. DC 20231. DO NOT SEND FSES OR COMPtETS^ RJfiMS TO TWS ADDRESS. SBHD TO: Asstoant Commte^er for Patents. 
Washingion, DC 20231. 
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PTOtssno (1-gm 

Appramt for use throuch 0a/3Q/aKXX 0MB 0651-0031 
Pstsnt and Tiademaric Ot^ as. DEPAITrUENT: OF- COMMERCE 
Unttef the Papenworic ReAicfcn Act cf 1995L no persons are rec^fred to f espcnd to a cojesfidn of Htarmefion uriess it dsftey» a valid 0MB ccrtd rurrtber. 



STATEMENT CLAIMING SMALL ENTITY STATUS 

(37 CFR 1,9(f) & 1.27{c))--SMALL BUSINESS CONCERN 



Docket Number (OptSonal) 



AppRcant; Patentee, or Iden^J^er. 

AppBcationorFf^ntNQ.:^ WQ Ol J- "-^ "-^ 



1 hcir^y^state 



(vner of the small t^lisinees concern tdentffied beicw: 



an offlcta} of the small business concern empowered to act on behalf of fhe concern Identified beksw: 



NAMEOFSMALLBUSINESSCONCERN 



ADDRESSQFSMALLBUSiNESSCONCERN /V>Vp/?"r^ j^/X^^ ' 



1 hereby state that the above tdentified smalt business concern qualifies as a small business concern as defined in 
13 CFR Part 121 for purposes of paying reduced fees to the United States Patent and Trademark Office. Questois related, 
to size standards for a small business concern may be dkected to: Small Business Administration, Size Standards Staff, 
4(» Third Street, SW. Washington. DC 20416. • T ' 

I hereby state that rights under contract or law .have been conveyed to and remain vnth the smalt business concern 
identified above vwtti r^faid to the hvention d6scnl>ed ni^ 

, specification filed herewith with litle as feted above. 

MiST theapplicati^ 
O the patent identified above. 

If the rights held by the above identified small business concern are not exdusrve, each IrKlividuai, concern, or 
organization having rights in the invention must file sepamte statemer^ as to th^ status as small entities, arnl no rights 
to the invention are held by any person, other than the inventor, who would not quafify as an Independent inventor tinder 
37 CFR 1.9(c) if that person made the invention, or by any concern which would not qualify as a small business concern 
uxfer 37 CFR l^d), or a nonprofit organization under 37 CFR 1.9(e). 

Each person, concern, or organization havlr^g arty rights in the invention is listed below: 
□Lno such person, concern, or ofganization e>dsts. . v a ^ •V* / v 

XSS each such person, concern, or organization listed bofaw.J^^p \j j Q^^J^^ 

SefKuate statements are required from each named person, concern or organization having riglWto t^invention 
stating their status as smaH en^. (37 CFR 127} 

. ' ' ' I acknowledge the duty to fte. In tiiis appficaftion or patent, notiftcaticn of any change ^ status iesid&>g In loss of 
entitiement to smaH entity skeftus prior to peeing, or at the time of paying, the'earfiest of the msue fee or any mabitenanoe 
fee due after the date on wNch status as a small er^ is no longer appropriate. (37 CFR 1.28(b)) 



NAME OF PERSON SIGNING . 
TfTLE OF PERSON IF OTHER THAN OWNER 
ADDRESS OF PERSON SIGNING 




SK3NATURE X/^^-^^. 



Surdfen Hot* Statement This focm w estimated fo take 0.2 hour« to complete: Time will vary depending upon the needs of the indwKlual cesei Any 
corrvnents en the emount of time you are requred to complete this form shotid be sent to the Chief informatton Officer. Patent and Trademark Office^ 
Washington, DC 20231. VO NOT SEND FEES OR OOMPLETBD FORMS TO THIS ADDRESS. SEND TO Assistant Commfesicxwr tor Patonfcs. 
WasHrgton^ DC 20231. 



(July 1999) 



